To become foolish, irrational, forgetful, etc, as if senile
[1920s+; fr an earlier phrase let his marbles go with the monkey, fr a story about a boy whose marbles were carried off by a monkey; lose one's taw (a choice playing marble), ''go crazy,'' is found by 1902]